Skip to content

[Feature] 模型选择qwen3时,有一个enable_thinking参数,希望添加自定义参数,模型默认思考会导致翻译时间过长 #1164

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
1 task done
leoz9 opened this issue Apr 30, 2025 · 13 comments
Assignees
Labels
enhancement New feature or request

Comments

@leoz9
Copy link

leoz9 commented Apr 30, 2025

Is there an existing issue for this?

  • I have searched the existing issues

Environment

  • Zotero Version: 7

Describe the feature request

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Why do you need this feature?
A clear and concise description of why you need this feature.

Describe the solution you'd like

The solution you'd like
A clear and concise description of what you want to happen.

Alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Anything else?

No response

@leoz9 leoz9 added the enhancement New feature or request label Apr 30, 2025
@RayQuantum
Copy link

支持,现在只能在prompt前面加/no_think来消除think里面的内容,但是删除不了

@leoz9
Copy link
Author

leoz9 commented Apr 30, 2025

qwen3,是在post请求里多了一个参数来控制思考的,和prompt这种不太一样吧

@RayQuantum
Copy link

确实是,但是prompt添加了think部分确实是没内容了,但是这个办法不如添加参数来关闭思考

@ramonmi
Copy link
Contributor

ramonmi commented Apr 30, 2025

尝试添加了Thinking设置,但是我这边没办法测试,@leoz9 可以帮忙测试下吗,可行的话我再开pr
translate-for-zotero-1164.zip
将.zip直接重命名为.xpi后安装插件

@leoz9
Copy link
Author

leoz9 commented Apr 30, 2025

尝试添加了Thinking设置,但是我这边没办法测试,@leoz9 可以帮忙测试下吗,可行的话我再开pr
translate-for-zotero-1164.zip
将.zip直接重命名为.xpi后安装插件

自定义GPT里没看到自定义thinking的地方

@ramonmi
Copy link
Contributor

ramonmi commented Apr 30, 2025

自定义GPT里没看到自定义thinking的地方

我这边试了下,还不太行,我再看看手册

@ramonmi
Copy link
Contributor

ramonmi commented May 1, 2025

支持,现在只能在prompt前面加/no_think来消除think里面的内容,但是删除不了

根据官方文档/think/no_think允许用户在enable_thinking=True的情况下,动态调整是否启用思考模式。因此,在prompt中添加/no_think和设置enable_thinking=False的效果应当是等同的,实测添加后翻译速度明显加快了,且没有展示思考过程。

并且因为是通用LLM服务,在插件设置层面添加该选项,有可能给其他使用类OpenAI服务的users增加额外无效checkbox,综合来看,在prompt中手动添加/no_think已经够用?

@leoz9
Copy link
Author

leoz9 commented May 1, 2025 via email

@IndigoFloyd
Copy link

IndigoFloyd commented May 7, 2025

如果能够过滤<think>标签就完美了,现在还得手动删一下

@bitons
Copy link

bitons commented May 8, 2025

没错

@Ma-Yongqiang
Copy link

在提示文本后加一个/no_think可以跳过推理步骤。
希望能够过滤掉think 标签
Image

@ramonmi
Copy link
Contributor

ramonmi commented May 11, 2025

请问prompt具体是怎么设置的呢?temp多少,我这里用着customGPT没有输出标签

@utopeadia
Copy link

请问prompt具体是怎么设置的呢?temp多少,我这里用着customGPT没有输出标签

think标签是默认带有的,qwen发布的博客说这是为了兼容性,所以即使使用/no_think也会输出一个空的“<think></think>”标签。所以需要客户端/前端对不需要输出think的场景进行过滤

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

8 participants